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^ I 1. Introduction and main result. The purpose of this paper is 

■ to study ruin probabihty when the claim process is nonstationary, 

has long range dependence, innovations in the domain of attraction 
of a stable distribution and when the premiums can barely cover the 
claims; hence the title. 

The motivation for such a study, beyond the development of 
some of the mathematics needed to build more realistic models for 
^ , some insurance companies, are manifold; this introduction seeks to 

^ I describe them, relating the content of this paper to various problems 

considered before. 

To start with, the claim processes we are interested in encom- 
pass many nonstationnary fractional autoregressive moving average 
(FARIMA) processes without prehistorical influence. As such, they 
also include the usual partial sum process. From an applied per- 
spective, these processes are of interest because they are part of the 
standard models in time series, and their ontological justification as 
aggregation of simpler processes (Granger, 1980) has some appeal in 
economics and econometrics. From a theoretical perspective, their 
interest lies in the fact that they are not Markovian, may not have 
stationary solutions, may exhibit long range dependence, so may 
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not be amenable to the classical techniques, and yet are tractable. 
Consequently, a technical understanding of these models yields a 
greater understanding of the underlying stochastic phenomenon in- 
volved in simpler models. Indeed, as less technical tools become 
available, we have to resort to more fundamental aspects of the pro- 
cess involved. In that respect, the main contribution of this paper 
is threefold: firstly, it reveals the role of extreme values in fractional 
random walks with innovations in the domain of attraction of a non- 
Gaussian distribution; secondly, it gives a method of proof which, 
unlike all those we are aware of for the classical random walk, does 
not rely on either some form of Kolmogorov's maximal inequality 
or the Wiener-Hopf factorization — see a discussion of the classi- 
cal proofs in Shneer and Wachtal (2009); thirdly, it shows that the 
so-called exponential representation of uniform order statistics may 
be used in sequential problems, even though this representation is 
nonsequential in nature. 

A certain number of results known for the partial sum process 
have been extended to its fractionally integrated version, and, more 
generally, to FARIMA ones. For instance, motivated by applications 
in econometrics, Donsker's (1951) invariance principle, asserting the 
convergence of the rescaled partial sum process to a Wiener process, 
has been extended to some FARIMA processes by Philipps (1987) 
and Akonom and Gourieroux (1987); the latter authors showed that 
a fractional integral of the Wiener process, that is, a fractional 
Brownian motion, may arise as limiting process — sec Wu and 
Shao (2006) for extensions and further references. In a similar 
spirit, Barbe and Broniatowski (1998) extented Varadhan's (1966) 
large deviation result for partial sums to some FARIMA processes 
— see also Ghosh and Samorodnitsky (2009) for related results 
in the stationary case. In that extension, the derivative involved in 
Varadhan's action functional was replaced by a fractional derivative. 
The classical ruin estimate of Cramer has been partially extended 
by Barbe and McCormick (2008b); and its heavy tail analogue, 
Veraverbeke's (1977) Theorem 2, has been also studied in the setting 
of FARIMA processes by Barbe and McCormick (2008a). The 
general thrust of these works is to understand how classical results 
for partial sums extend to their fractional analogue, somewhat 
paralleling the developments related to fractional Brownian motion 
and fractional Levy processes in probability. 

In the classical applied probability area of queueing theory, a well 



2 



studied topic is that of the so-called heavy traffic approximations, 
referring to an asymptotic analysis of the behavior of queues with 
traffic intensity near one. In an insurance mathematics setting, 
this translates into studying a risk process when the premium can 
barely cover the claims. For the partial sum process, heavy traffic 
approximations are well understood and a presentation in book form 
may be found in Resnick (2007) — see also Shnccr and Wachtel 
(2009) as well as Kosihski, Boxma and Zwart (2010) for further 
references and results, and Whitt (2002) for examples of applications 
in queueing theory. One of the purposes of this paper is to present 
an analogous result in the setting of FARIMA processes. 

In yet another direction which we will not pursue, heavy traffic 
approximation can be interpreted in terms of moving boundary 
crossing probability. In particular, our result can give the probability 
that a fractional random walk, or more generaly, a FARIMA process 
without prehistorical influence, crosses a moving curved boundary. 

Throughout this paper we use the letter c for a generic constant 
whose value may change from one occurence to another. 

We use the symbol < between two sequences, as in say a„ < 6„, 
to signify that a„ ^ 6„(l + o(l)) as n tends to infinity. 

2. Main result. The processes which we will be dealing with are 

defined through an analytic function g on (—1, 1) and a distribution 
function F on the real line. These two pieces of data allow us to build 
a so-called (5, F) -pro cess as follows. Consider a sequence (Xj)j^i of 
independent random variables, all having F for distribution function. 
We consider the series expansion of g, 

A (g, F)-process (S'„)n>o is defined by So = and 

Setting = if i is negative, and writing B for the backward shift 
operator acting on sequences, that is BXi = we see that the 

above expression for Sn amounts to 

Sn = g{B)X^ . 
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If g{x) = 1/(1 — x), then {S^) is the partial sum process of the 
Xi. If ^ is a rational function continuous on [ — 1, 1], then a {g,F)- 
process is an ARMA one. If (7 is (1 — Id)~'^ times a rational function 
continuous on [ — 1,1], then a {g, F)-process is a FARIMA one. 

Introducing the notation 



we see that if F has finite mean, then 5„ = g{B){Xn — EX„) + 
5[o,n)EXi. If the sequence {gn) is ultimately positive and not 
summable, then 5„ drifts to +00 if EXi is positive and —00 if 
EXi is negative. Our heavy traffic approximation yields the limiting 
behavior of max„^o Sn as the expected value of Xi tends to from 
below. This amounts to assuming that the innovations are centered 
and seek the asymptotic behavior of max„^o(>S'n — ofi'[o,n)) ^ 
tends to from above. As mentioned in the introduction, this can 
be interpreted as a problem on moving boundary crossing, for the 
inequality max„^o('S'n — oS'io.n)) > a; is equivalent to the process 5"^ 
crossing the boundary x + a(7[o,n)- 

A simple examination of known heavy traffic approximation re- 
sults for the classical random walk shows that different asymptotic 
behaviors are to be expected according to the tail behavior of the 
innovation, and, in particular, according to the finiteness of the vari- 
ance. The invariance principle of Barbe and McCormick (2010) also 
suggests that one should distinguish the cases where the sequence 
(gi„) diverges to infinity and that where it tends to 0, correspond- 
ing respectively to a fractional integration and differentiation of the 
random walk. In this paper, we will concentrate on the fractional 
integration; a companion paper deals with the fractional differentia- 
tion. This discussion, as well as technical requirements for the proof 
lead us to introduce some assumptions. 

The summability of the gi is related to the behavior of g near 
— 1 and 1, and bears on the long range dependence properties of the 
process. We will restrict ourselves to what Granger (1988) called the 
generalized integrated processes, assuming that 

g(\ — 1/Id) is regularly varying of positive index 7. (2.1) 

Karamata's theorem for power series asserts that if (p„) is asymp- 
totically equivalent to a monotone sequence, then (2.1) is equiva- 
lent to [g^ being regularly varying of index 7 — 1. In this case, 
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9i/gn ~ (i/n)^ ^ as n tends to infinity and i/n stays bounded away 
for the origin and infinity. We will assume more; firstly, that 

(gn) is normalized regularly varying, (2-2) 

meaning that (see Bingham, Goldie and Teugels, 1989, Theorem 
1.9.8) 

^ = 1 + ^(1 + 0(1)) 

9n n ^ ^ " 

as n tends to infinity, and, secondly, that there exists a positive 5 
such that 

lim sup ^ (l^V =o. (2.3) 



We will prove that assumptions (2.2) and (2.3) hold for FARIMA 
processes; therefore, they are not overwhelmingly restrictive in 
applications. Note that (2.3) implies (2.1) and that there is no loss 
of generality to assume that 5 < 1/2; indeed, if (2.3) holds for some 
S, then it holds for any smaller one. Furthermore, (2.2) implies (2.1) 
as well. 

As far as the innovations are concerned, we assume that they have 
a mean but no variance, and, more precisely, that 

F is centered and in the domain of attraction of a 

stable distribution of index a in (1,2). (2.4) 

Whenever G is a cummulative distribution function, we write 

G for 1 — G. We write for the distribution function of \Xi\. 
Assumption (2.4) implies that one of the tails of F is regularly 
varying of index —a and that F is tail balanced, meaning the 
following. Write for the distribution function of —X. Then 

coincides with F + M^iF on the positive half- line when F 
is continuous. The tail balance condition is that F pF^ and 
M-iF ~ qF^, at infinity where p and q are nonnegative numbers 
which add to 1. For simplicity, we consider throughout the paper 
and without mentioning it any further that p does not vanish. 
Writing 

F^{u) = mf{x : F{x) ^ u} 

for the caglad quantile function associated to F, (2.4) implies that 
F'^{1 — 1/Id) is regularly varying of index 1/a; if g does not vanish. 



5 



{M_iF)^{l — 1/Id) is regularly varying of the same index 1/a. 
Paralleling (2.3), we assume that for some positive k, 



lim sup 

If this assumption holds for some k, then it holds for any smaller one. 
While this assumption is stated in a form convenient for our usage, 
its meaning is made more explicit in the following result, whose proof 
is deferred to section 4. 



F^(l-l/t) 



(2.5) 



(ijt" sup TTTV--^"^^" =o{l). 



Proposition 2.1. Let k be a positive real number less than both 
1 and 2/{a + l). The following are equivalent as t tends to infinity: 

F^jl-X/t) 
F-(l-lA) 

(ii) F^{1 -l/t) = cti/«(l + o(i-'^(i+i/"))). 

Moreover, if F is continuous and increasing, it is also equivalent to 
(Hi) F(t) = (c/t)«(l + o(t-'^(«+i))). 

It is likely that our need for (2.5) is an artifact of the technique 
used in the proof, and that our result holds in a much greater 
generality. This issue is discussed after the proof, in section 3.6. 

Considering (l/(7„). Proposition 2.1 implies that condition (2.3) 
is equivalent to the existence of a positive e such that 

gn = cn'^-^{l + o{n-')) 

as n tends to infinity. 

Concerning the lower tail we will assume either an analogue of 
(2.5), namely 



lim t'^ sup 



(M_iF)-(l-AA) 



(M_iF)^(l - 1/t) 



0, (2.6) 



an assumption which is relevant when q does not vanish and in some 
cases when q vanishes, or, forcing q to vanish. 



M_iF(t) ^ cF{t log t) log t ultimately. (2.7) 

Note that while assumptions (2.6) and (2.7) do not cover all possible 
distributions, it is not much more restrictive than (2.5) in practical 
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applications; indeed all classical distributions which satisfy (2.5) 
satisfy either (2.6) or (2.7). 

The distribution function F yields the Levy measure u, defined 
by its density with respect to the Lebesgue measure A, 

^(x) =pQ!a;-"-^l(o,cx))(a;) +?Q;(-ar)"""^l(-oo,o)(a^) ■ 

It induces a Levy stable process Lq with Levy measure i^, that is 
a process with selfsimilar and independent increments, such that, 
under (2.4), 

^^itLoii) = exp^y (e**== - 1 - itx) dz/(x)) . 

The subscript is to indicate that this process is centered. A 
fractional Levy stable process is defined through the Riemann- 
Liouville integral 

Li''-'\t) = j l\t-uy-ULo{u). 
Jo 

We will use the function 

. _ Id 

F^(l-1/Id)- 

It is regularly varying of positive index 1 — 1/a. 
Our main result is the following. 

Theorem 2.2. Assume that 7 is greater than 1 and that (2.2), 
(2.3), (2.4) and (2.5) hold. If either (2.6) or (2.1) hold, then 

1 / ^^ sup(5„ - ai^[o,„)) = sup(4^"^^(t) - f^) . 

a->o a5f(l - l/A;^(l/a)j n^i t^o 

Moreover, the random variable supj^o(-^o''^~^'*(^) ~ t'') almost 
surely finite. 

Example. We consider a FARIMA process without prehistorical 
influence defined as follows. Let and <I> be two real polynomials, 
the roots of $ being outside the complex unit disk and 9 not 
vanishing at 1. The FARIMA process 

(1 - B)''<PiB)Sn = Q{B)Xn 

7 



is a (5, F) -process with g = {1 — Id)~^Q/^. We assume that 7 is 
greater than 1. This process is then a fractionally integrated random 
walk. 

Lemma 6.1 in Barbe and McCormick (2010) implies that assump- 
tion (2.2) holds. Checking that (2.3) holds is easy, because Lemmas 
6.1 and 6.2 in Barbe and McCormick (2010) show that when g is 
(1 — ld)~'^Q/^, there exists a converging sequence (a„) such that 



9n 



cn ' 



This implies that whenever i and n tend to infinity with i at most 
n, 



n 



Q„, \nJ \n 



1 + ai/i 



1 + an/n 



n 



n 



(2.8) 



If i is in the range [n^~^,n], then /i tends to whenever 6 is less 
than 1/2, and, similarly, /n tends to as n tends to infinity. Since 
(on) converges, we see that (2.8) implies (2.3). 

To fix the ideas, consider a distribution function F such that 
F{x) ~ ex"". Then F^(l - 1/t) ~ (ct)^/" as t tends to infinity. 
Since F^^(l - 1/i) ~ p-i/«F^(l - 1/t), we obtain 

k{t) - (p/c)i/°i("-^)/« 

as t tends to infinity. It follows that 

k^{l/a) - (c/p)i/("-^)a-«/("-^) 

as a tends to 0. Since g{l — 1/x) ~ x'^&{l)/^{l) as x tends to 
infinity, we have 



ag 



■af)/{a-l) 



9(1) 



(1/a); ^ $(1) 
as a tends to 0. Hence, assuming that (2.5) holds, we obtain that 

(c/p)7/("-l)' 



sup(S'„-a5'[o,„)) ~ 

n>0 



*(!) t>0 
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as a tends to 0. In particular, the left hand side grows like 
Qi-7a/(a-i) It ig interesting to note that the exponent involved 
depends on a and 7 only through ^a/{a — 1), that is 7 times the 
conjugate exponent of a. 

3. Proof of Theorem 2.2. For the classical random walk, there 

exists two ways of proving a heavy traffix approximation: one based 
on the Wiener- Hopf factorization proposed by Kingman (1961, 1962, 
1965), one based on a functional limit theorem proposed by Prohorov 
(1963). We follow Prohorov's approach. 

Throughout the proof we will use many times the following form 
of Karamata's theorem for power series (see Bingham, Goldie and 
Teugels, 1989, Corollary 1.7.3). If (5^) is regularly varying of positive 
index 7 — 1, it is asymptotically equivalent to an increasing sequence 
and 

7g[0,n) - 1/n) , . 

9n ~ ~ ^:rr^; — (3.1) 

as n tends to infinity. 

To proceed with the proof, up to an asymptotic equivalence, define 
A = A(l/a) by the relation 

ak{A) ~ 1 (3.2) 

as a tends to 0. It follows from Barbe and McCormick's (2010) 
Theorem 5.2 that, in the sense of weak* convergence of distribution 
of stochastic processes in D[0,oo) endowed with the topology of 
uniform convergence on compactas. 



9[0,A) 



5" [Aid J — > 



as A tends to infinity. Since (3.1) and (2.3) imply that (5[o,n)) is a 
regularly varying sequence of index 7, (3.2) implies that we have the 
convergence of stochastic processes 



(^LAidj - a5[o,Aid)) A 4-^-^) - Id^ . (3.3) 



g[Q,A) 

Consequently, for any positive T, 

sup {Sn - agiQ^n)) sup (4^"^^(t) - r) 

5[0,A) O^n^AT O^t^T 
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as a tends to 0. 

Since supq^j^-^ (-^o''^"^'' (*) ~*''^) is nondecreasing in T, it converges 
almost surely as T tends to infinity, possibly to infinity. Hence, to 
prove Theorem 2.2, it suffices to show that 

lim lim sup P{ 3n > AT : Sn > ag^o „) } = (3.4) 

and suPj^q(Lq''^ ~ i^) is almost surely finite. 

As pointed out by Shneer and Wachtcl (2009), or differently in 
Szczotka and Woykzyhski (2003), the main difficulty in proving a 
heavy traffic approximation for sums is to show that the maximum 
of the process does not occur too far in time, that is, in our case 
proving (3.4). In the context of (g, i<')-processes this task is far more 
involved than for ordinary random walks, mostly because there is no 
analogue of Kolmogorov's maximal inequality. In order to explain 
our proof, that is, the remainder of this paper, we need to make a 
preliminary study of (3.4). 

Given (3.2), we see that (3.4) is equivalent to 

lim limsupP{3n > AT : > 5[o,„)/A;(A) } = 0. (3.5) 

T-foo A->oo 

Substituting A for AT, using that 

k{A/T) ~ T(i/")-1A;(A) 

as A tends to infinity, and using that 1 — 1/a is positive, substituting 
T for 7^1-1/"^ -we obtain that (3.5) is equivalent to 

lim lim sup P{ 3n > A : S'^ > Tgyo^^Jk^A) } = . (3.6) 

T-)-oo A^oo 

We can now explain how to prove Theorem 2.2. The proof has four 
main steps. The first two aim at showing that instead of considering 
all n exceeding A in (3.6), we can reduce the range to all n between 
A and A^^*^, where e is positive but can be chosen as one wishes. 
This is achieved by showing in the first step that the innovations 
coming from the central part of the distribution can be ignored. In 
the second step, a simple bound on the contribution of the largest 
innovations permits us to show that if the event involving Sn in 
(3.6) occurs, it is very likely that n is less than A^"'"'^. Being able to 
concentrate on the range of n between A and A^"*"*^, the third step 
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consists in showing a result similar to that of the first step, namely 
that the innovations not too large can be ignored; while this mid- 
range depends on n in the first step, this dependence will be, in 
some sense, less so in the third step. The fourth step, by far the 
most complicated, consists in showing that the contribution of the 
extreme innovations to Sn, properly rescaled, can be approximated 
by a fractional Levy process, uniformly in the range of n between 
A and A^"*"*^. While this shares some similarity with (3.3) and will 
be proved with a technique inspired by our proof of (3.3), this is 
more difficult than proving (3.3). The reason is that in (3.3) we 
approximate the process 5„ on [0,A], which is A times the fixed 
compact set [0,1]. In contrast in our problem, the set [A, A-^"'"'^] 
should be thought as A times [IjA*^], that is A times an interval 
whose length diverges with A. This forces us to develop a sequential 
analogue of the representation used in Barbe and McCormick (2010), 
and it is likely that the technique used will be of value for related 
boundary crossing problems. A fifth step concludes the proof, mostly 
taking care of the lower tail of the distribution and doing some 
bookeeping. 

3.1. Step 1. We first consider the part of the process (Sn) made 
from the not too large innovations. In order to set up the proper 
thresholdings, let (a„) and (6„) be two sequences of real numbers 
such that 

lim a„ = — oo and lim 6„ = +00 . 

n— >oo n— >oo 

Since F obeys a tail balance condition and we suppose that p does 
not vanish, it is convenient to assume that 

lim bn/ {—an) is positive or infinite. 

n— >cx> 

We define the variance of the truncated innovations, 

c7„ = Var(Xl[„„,b„](X)), 
and the centered and standardized 'middle' innovations, 
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The 'middle' part of Sn is then 

= 9iZn-i,n ■ 

Given that we use (a^) and (6„) to truncate the innovations and 
that we win use a quantile transformation, it is convenient, as in 
Barbe and McCormick (2010), to take both sequences as quantiles. 
Since both sequences arc constructed in similar fashion, we explain 
that of (fc„). We consider a sequence which is regularly varying 

of positive index /3 less than 1. We set 6„ = F^{1 — rhn/n). Setting 
rUn = nF{bn), the sequence 

(m„) is regularly varying of index 

as well. We then take 

bn = F^{1 - mn/n) . 

Since (m„) is a regularly varying sequence of index /3, the sequence 
(bn) is regularly varying of index (1 — j3)/a. 

This construction ensures that (m„) is regularly varying of index 
P and l — nin/n is in the range of F. This ensures that the inequality 
— u) > hn is equivalent iou < nin/n (see Shorack and Wellner, 
1986, §1, pp. 5-7). It is implicit that a similar construction is made 
for (a„), switching the tails. 

In order to avoid heavy subscripts and many integer parts brack- 
ets, we will sometimes use the function m(-) defined by m{x) = m^a:] ■ 
We will also write m^; for m yx\ ■ 

Our next proposition asserts that the middle part can be neglected 
in our problem. Recall that the parameter /3 regulates the growth of 
our truncation sequence used to define M„. 

Proposition 3.1.1. For any f5 positive and less than 1, for any 
positive T , 

lim P{ 3n ^ A : M„ > Tgio,n)/H^) } = . 



Proof. Lemma 2.1.1 in Barbe and McCormick (2010) asserts that 



o"n ~ cbnJ F{bn) ~ cF^(l - mn/n)y^mn/n 
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as n tends to infinity. Inequality (2.2.1) in Barbe and McCormick 
(2010) impfies that for any positive integer r there exists a constant 
Cr such that for any positive n, 



\(Tr,\/n/ n . 4-^ 



9i 



Jo 



the asymptotic equivalence being as n tends to infinity. Using 
Markov's inequality and (3.1), for any positive integer r, 

P{ M„ > Tg^o,n)/k{A) } ^ cd^-^^^^Y 



as A tends to infinity and uniformly in n ^ A. Since a is less than 2, 
let be a positive real number so that (1/2) — (l/a) + is negative. 
Potter's bound implies 

k{—) > m(,V«)-i-'?A;(n) . 
It follows that (3.1.1) is of order at most 

_^^K(l/2)-(l/a)+»7) ( MAI V 

T-""" \k{n)) • 

For T and A large enough, this bound is less than 1 since (1/2) — 
(l/a) + is negative, r is positive, and k is regularly varying of 
positive index. Applying Bonferroni's inequality, we obtain 

P{3n> A : > Tg^o,n)/k{^)} 

^ ^m^^('/'^-^'/'^^+^h{Ay k{n)-^ . (3.1.2) 

Taking r greater than a/ {a — 1) ensures that the series of generic 
term k{n)~'^ converges and that J2n>A k{n)~'^ is of order Ak{A)~^ as 
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A tends to infinity. In this case, (3.1.2) is of order rn'J^^^^'^^~^^^°'^^^^ A. 
This bound is regularly varying in A of index ^r((l/2)— (1/ oi)+ri) +1 . 
This index is negative whenever r is large enough. ■ 

3.2. Step 2. We consider the contribution of the extreme innova- 
tions to Sn, 

Tn = ^ 9i^n-i'^{bn,oo){^n-i) ■ 
0^i<n 

In order to understand precisely the role of (2.5) wc introduce a 
slight refinment. Let be an ultimately increasing slowly varying 
function, diverging to infinity at infinity, such that C(n^) ~ c^(n) as 
n tends to infinity, and 

V— ^<oo. (3.2.1) 

One could take ^(x) to be (logx)^"'"'' or (log x) (log log x)-^"'"'' for some 
positive ?7; one may simply replace ^(n) by log^ n when reading the 
remainder of the proof. However, having introduced the function 
^ will allow us to understand the role of (2.5). Sometimes we will 
write ^„ instead of ^{n). The key requirement, (3.2.1), is equivalent 
to the assertion that the smallest of n independent random variables 
uniformly distributed over [0,1] is greater than Xjin^^ almost 
surely for n large enough (see Geffroy, 1958, 1959, and Kiefer, 1972); 
the other conditions are of technical nature. 

We introduce the following variant of (2.5): there exists a real 
number p greater than 1 such that 



lim sup sup 



(1 - A/n) _ 



<oo, (3.2.2) 



l/mn^A^m„ -F"*"(l - 1/n) 

as well as the condition 

liminf m„/^„ > 0. (3.2.3) 

n— >cx) 

Note that if (m„ ) is regularly varying of positive index /5 less than 
K, then (2.5) implies (3.2.2) and (3.2.3); indeed, (2.5) the implies 



lim rf" sup 



F^(l - A/n) 



A-iA 



0, 
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and, considering the indices of regular variation, we can take p to 
be any number greater than 1 and less than n/^. In what follows 
will rely solely on the combination (3.2.2) and (3.2.3), and, except 
specified otherwise, not on the positivity of the index of regular 
variation /3 of (m„). In particular, if (5 is allowed to vanish, (m„) is 
allowed to be slowly varying. Ultimately, this will inform us on the 
role of (2.5). A further discussion is presented in section 3.6. 

Proposition 3.2.1. Let e he a positive real number. If 

( e a — \\ 
\ 1 + e a J 

then for any positive T, 

hm P{ 3n ^ A'+' : \T+ - ET+\ ^ Tg^o,n)/k{K) } = . 



In order to prove Proposition 3.2.1, we need the following esti- 
mates on the expectation = EXl[b^ {X). 

Lemma 3.2.2. If (3.2.2) holds, then 



lim sup 



a 



a 



1-1/a 



< OO . 



Proof. Let U he a uniform random variable over [0, 1]. Thinking 
of the random variable X as F^(l — U), 

n / — — 7- , , , du 



F^(l-l/n) Jo F^(l-l/n) 

F^(l-v/n) , 
■ av . 



F^{1 - l/n) 



Assumption (3.2.2) yields 

F^(l-u/n) 
iM„ F^(l-l/n) 



dv= v-^/" + 0{m-^)dv 

J l/m„ 

" -m^-V° + 0(l). 



a — 1 
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Furthermore, Potter's bound implies that for any 77 positive less than 
{a — l)/a, as n tends to infinity, 

This proves the lemma. ■ 
Note that Lemma 3.2.2 implies, as n tends to infinity, 



Proof of Proposition 3.2.1. The proof has two steps. In the 

first one we prove that, almost surely, T+ cannot exceed g'[o,„)/A;(A) 
whenever n exceeds A^"'"'^ and A is large enough. In the second one, 
we prove a similar assertion on the expectation ET^. Recall that 
since (gn) is regularly varying of positive index, it is asymptotically 
equivalent to a nondecreasing sequence. 

Step 1. Let {Ui)i^i be a sequence of independent random variables, 
uniformly distributed on [0,1]. There is no loss of generality in 
assuming that Xi = F^(l — Ui). Since we use the caglad version of 
the quantile function and 1— m„/n is in the range of F, the inequality 
F'^(l — U) > F^{1 — rrin/n) occurs if and only if U < rrin/n (see 
Shorack and Wellner, 1986, §1.1, pp. 5-7). Therefore, writing for 
the empirical distribution function of {Ui)i^i^n, we have, for any n 
large enough, 

= I] giF^{l-Un-i)l{Ui^mn/n} 

^ 2gnF^{l - Ui^n)nl]n{mn/n) . (3.2.5) 

Prom Theorem 1 in Kiefer (1972) we deduce that C/i^„ ^ ^/n^n 
almost surely for n large enough, and from Theorem 2 in Shorack 
and Wellner (1978), we conclude that Un ^ ■Cnid almost surely for n 
large enough. Therefore, using (3.1), (3.2.5) is ultimately at most 

(1 \ Tn 
1 - ^ rrin^n ~ cgio,n) • (3.2.6) 
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Recall that m(-) is the function such that m{x) = 771^3,] . Provided P 
is less than 1 — 1/a, the function mn^^/k{n^n) is regularly varying 
in n of negative index P — 1 + (l/a). Thus, (3.2.6) is at most 

in the range of n at least A^"'"'^ and for any A large enough. To see 
that this is less than g[Q^n)/k{A.), note that, considering the index of 
regular varition, the inequality 

m(Ai+^)^2(^i+£) 1 



holds since 



whenever 



A;(Ai+^^(Ai+^)) A;(A) 

(l + e)f^-l + -) <-l + - 
\ a/ a 



e a — 1 

< 



1 + e a 
Step 2. Using (3.2.4), 

as n tends to infinity. Potter's bound to compare k{n) and k{n^n) 
shows that (3.2.7) is less than (3.2.6), and therefore less than 
9[o,n)/k{A.) in our range of n and A of interest. ■ 



Combining Propositions 3.1.1 and 3.2.1, wc sec that, ignoring for 
the time being the lower tail of F, Theorem 2.2 will be proved if we 
show that for some e positive, 

hm limsupP{3n € {AA'^l : |r+ - ET+\ ^ Tg^o,n)/k{A) } = 0. 

T^oo A-)-oo 

(3.2.8) 

As can be seen in the remainder of the proof, the fact that the 
innovations are kept in T+ if they exceed a threshold 6„ in which 
m„ depends on n creates some complications. So, it is better to 
backtrack from (3.2.8), and instead, still using Propositions 3.1.1 
and 3.2.1, to argue that, still ignoring the problem of the lower tail 
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of F for the time being, Theorem 2.2 can be proved by showing that 
for any positive e, 

Km UmsupP{3n G (A,A^+') : \SJ ^ Tg,o n)/H^)} = . 

(3.2.9) 

In the next step we show that we can now consider only the extreme 
values larger than some bn,A calculated with a sequence niA instead 
of m„. 

3.3. Step 3. We now concentrate on the range of n between A and 
A^+^. Imitating the notation used in step 1, let 

and similarly for (a„^A)- We set 

a,,A=Var(Xl[„„,,fe„,](X)). 

Using the same notation as in step 1, but for a slightly different 
quantity — note indeed that we substitute an,A and bn,A for and 
bn — consider the standardized middle innovations, 

7 _ ^iMar.,A,br.,A]i^i) - E^1k.a,&„.a](-^) 1 ^ • ^ 

^i,n — , i ^ Z 77. . 

0'n,A 

Again, with a slight change of notation compared to step 1, the 
corresponding middle part of Sn is then 

-^n = Cn,A 9iZn-i,n ■ 

As in step 1, this middle part can be neglected in our problem. 

Proposition 3.3.1. For any (3 positive and less than 1, for any 
positive e and T, 

hm P{ 3n G (A, A'+-) : M„ > Tg[o,n)/HA) } = . 

Proof. The same estimates as in Proposition 3.1.1 give the analogue 
of (3.1.1), namely, that for any positive integer r, 

P{ M„ > r„„,„,/fc(A) ) ~ ^,n-''{^^y (3.3.1) 
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as A tends to infinity and uniformly in n in (A, A^+"^). Let rj he a 
positive real number. Potter's bound implies that uniformly in the 
range n in (A, A^+^), as A tends to infinity, 

If follows that (3.3.1) is of order at most 

C r((l/2)-(l/a)+7,) 

Applying Bonferroni's inequality, we obtain 

P{3n G (A,Ai+^) : M„ > Tg[o,n)/kW } 

^^^^((V2)-(i/a)+.)^i+._ ^332) 

This bound is regularly varying in A of index ^r((l/2) — (l/a) + 
r]) +1 + 6. This index is negative whenever 77 is small enough and r 
is large enough. ■ 

3.4. Step 4. We consider the contribution of the extreme innova- 
tions to Sn- We consider bn,A = F'^{1 — m^^/n) as in the previous 
subsection. With again a slight change of notation compared to step 
2, we set 

Paralleling what we did in step 2, we seek to prove the following 
proposition. 

Proposition 3.4.1. Let e be a positive real number. If P is small 
enough, then for any positive T , 

lim limsupP{3n G (A, A1+^) : \T+ - ET+I ^ Tg[o,n)/k{A) } = 0. 

The proof of this proposition is far more difficult than that of 
Proposition 3.2.1. It first requires several approximations of r+. 
Our goal at the end of these approximations amounts to be able to 
replace T+ - ET+ by about L^^~^\n)/k{n). 
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Given a positive e as in Proposition 3.4.1, we introduce for 
notational simplicity 

N = . 

The exponent could as well be taken to be 1 + e but adding an extra 
e will slightly simplify some of our arguments. 

Following the construction in Barbe and McCormick (2010), let 
Xi,N ^ ^ • • • ^ Xpf^N be the order statistics of the innovations 

(Xi)i^j^Ar. Let T be the random permutation of { 1, 2, . . . , A'' } such 
that 

^T{i) = ^N-i+l,N ■ 

We set Qi to be if i is negative. For any n positive at most A'', the 
equality 

= X] 5'n-r(i)^Af-i+l,ivl(6„,A,oo)(^iV-i+l,Ar)l{T(z) ^ n} 

holds. Let {Vi)i^i^N be a sequence of independent random variables 

uniformly distributed over [0,1], independent of (^i,jv)i^i^iv- Let 
Gjv be their empirical distribution function, 

Gn{x) = N-' HVi^x}. 

Without any loss of generality, even if F is not continuous, we assume 
that r(i) = NGN{Vi), giving 

Tn = gn-NGN{Vi)^N-i+l,N 

l(6„,A,oo)(^iV-i+l,iv)l{iVGiv(V^z) ^ n}. 

Let {oJi)i^i be a sequence of independent random variables having 
a standard exponential distribution. For any positive integer i we 
define the partial sum Wi = uji + ■ ■ ■ + Ui. Since {Wi/WN+i)i^i!^N 
has the same distribution as the order statistics of independent 
uniform random variables (see Shorack and Wellner, 1986, chapter 
8, §2), 

(x._.,,„)i(F-(i-J^L)) . 
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Since we use the caglad version of the quantile function, the inequal- 
ity F'^{u) > bn,A is equivalent tou < m^^/n. Therefore, introducing 
the random set 



T^l,n,N = \l : rr- ^ ; GN{Vi) ^ — \ 



and the random variable 

W, 



Ttn,N= E 3n-NG.mF^(}-^^y (3.4.1) 

we have (r+)i^„^jv = (?'it„,iv)i^n^iv- 



Remark. The main reason we proved Propositions 3.1.1 and 3.2.1 
is that once we can reduce n to be bounded from above by some 
given quantity — in our case A^+^ — we can use the representation 
of the innovations with (Wj) and obtain (3.4.1). 

Let //+^ be EX 1(6^ 

,A,oo)(-'^)) SO that ET^ — 5[o,n)A'^,A- O^'^ 
discussion shows that in order to prove Proposition 3.4.1 it suffices 
to prove that 

^lim limsupp{ 3„ e (A, A=-) : lr+„,, - S[„,„,m„M > rf£g } 

= 0. (3.4.2) 

This will be achieved by approximating T^^ by a much simpler 

process. While the main approximation scheme follows that in 
Barbe and McCormick (2010), a main difference lies in the sequential 
nature of the event involved in (3.4.2); indeed, contrary to Barbe and 
McCormick (2010) we need more than an approximation of T^^ 
valid for a range of n of comparable order, but for n between the 
different orders A and A^"*"*^, that is over a much larger range. To 
make this approximation, it is essential to have some understanding 
of the set Tli,n,N- 

The point process Yli>i ^{Wi,Vi) is a Poisson process of intensity 
the Lebesgue measure on [0,oo) x [0,1]. Viewing this point process 
in a {w, i;)-plane, we can think of 7^i,n,Af as a region in this plane 
given by 

{{w,v) : w ^ WN+iiriA/n; Gn{v) ^ n/N } . 
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So we will write about the 'set' TZi^n,N when we think of it as a subset 
of the integer and about the 'region' 1Zi^n,N when we view it as a 
set of points in the {w, t;)-plane. The key fact to understand, which 
we will formalize in our next result, is that, considering TZi^n,N, if 
n is small the inequality GN{Vi) ^ n/N will select few points and 
because Vi will be quite small, we will wait for a long time, that is we 
will need to have i large, in order to hit this Vi] but for large i, the 
sum Wi will be large and so Wi/Wm+i will not be less than mfy/n. 
If n is large, then the inequality Wi/Wn+i ^ nif^/n forces i to be 
quite small, and so, regardless of n, we should have very few points in 
T^i,n,N- A different argument, less informative in our context though, 
is that since we retained the innovations exceeding F^{1 — m\/n) 
in T^^ jy, there should be about rriA of those contributing to j^. 
Thus, the cardinality of 'R-i^n,N should be about mp^. 

Still considering IZi^n^N, if we replace Wn+i by its near expected 
value and approximate Gn by its limit, the identity function on 
[0, 1 ], we should have 

n 

Vi ^ — and Wi ^ tua— ■ 
N n 

These two inequalities force {Vi, Wi) to belong to the much simpler 
region {{v,w) : u ^ m\/w }, which is the subgraph of an hyperbola. 
The replacement of Gn by its limit cannot be done at this early stage 
and we will have to settle for less, bounding Gjv by a multiple of its 
limit. This leads us to introduce, for any positive c, the region 

T^A,c = {{v,w) : v^c"^ ; i«^2iv}. 

Our next result asserts that provided c is large enough, it is very 
likely for the regions TZi^n,N to be included in TZa,c, and that the 
minimum of the set TZi,n,N is very likely to be at least N/n^N. 

Lemma 3.4.2. For any positive rj there exists a real number c 
such that for any A large enough, 

P ( n A^n^Ai+- { '^l,n,N C 7^A,c ^ 1 - ?? • 

Moreover, viewing Tli^n,N as a set of integers, 

lim Pf flA^n^Al+«|nlin7^l,„,Ar ^ |) = 1- 
A->oo \ L n^N J ' 
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Proof. Let 77 be an arbitrary positive real number. Inequality (2) 

in Shorack and Wellner (1978) (see also Shorack and Wellner, 1986, 
chapter 10, §3, inequality 1, p. 415) and the strong law of large 
numbers ensure the existence of c such that the event 



has probability at least 1 — rj whenever N is large enough. On ^n, 
if i belongs to TZi^n,N, 



the first equality coming from the condition Gjv(Vi) ^ n/N, the 
second inequality from being in rj^r, the third from the condition 
Wi/W^+i ^ "fnt^jn, and the last from being in iljv. Thus, up to 
replacing c by twice as much, 7^i,n,Af C 7^a,c on Ojv, proving the 
first assertion. 



Given (3.2.1), Geffroy (1958/1959) or Kiefer's (1972) Theorem 1 
imply that for c small enough the event 



has probability at least 1 — ry. If i belongs to TZi^n,N and occurs, 
Vi ^ cn/N, and, in particular, Vi^i ^ cn/N. Therefore, on QD^In 
we must have l/(i^i) ^ cn/N, that is, i^i ^ cN/n. In particular, 
i ^ cN/{n^i). However, if i is in TZi,n,N, then i is at most N, 
and since (^„) is ultimately monotone, we obtain that i is at least 



As a consequence of Lemma 3.4.2, we can show that the region 
T^i,n,N cannot contain too many points if /3 is small. 

Lemma 3.4.3. max^^^^^^+s tj'7^i,n,JV = Op{'mA^ogN). 

Proof. Since Vi is uniform over [0,1] the region TZa,c can be 
restricted to 



Vi ^ Vn,N ^C— ^ CmA 



Wn+1 1 
Wi N 




cN/{niN). 



{{v,w) : V ^ {cm\/w) f\l\w ^ 2N } . 
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The Lebesgue measure of this region is of order cmA log(2A^). The 
result follows since Yli^i ^{Vi,Wi) is a homogenous Poisson process 
with mean intensity 1 and Lemma 3.4.2 holds. ■ 

We will use the following lemma, which we state now for conve- 
nience. 

Lemma 3.4.4. Let {Ili,n)i^i^n be some Poisson random vari- 
ables, possibly dependent, having respective means {\i,n)i^i^n, such 
that for some e positive, maxi^j^„ Aj_„ = o(n~^). Then, for A; ^ 2/e, 

lim P{ max Ilj „ ^ A; } = . 



Proof. Chernoff's inequality yields for any positive k, 

P{ Ili^n ^ } ^ exp(-A; \ogk + k log Ai,„ + k- Ai,„) . 

Given the assumption on (Ai^„) this upper bound is, for any n large 
enough, at most exp(— A; log k — ek log n + k). The result follows from 
Bonferroni's inequality. ■ 

Since we will make repeated use of the following simple argument 
or obvious variants of it, we state it as a lemma. 

Lemma 3.4.5. Let (e„) be a bounded sequence of positive real 
numbers. There exists a positive T such that for any n at least A 
and any A large enough, 

F^{1 - l/n)5„e„ ^ Tg^^^^^/k^K) . 



Proof. Given (3.1), the inequality amounts to e„ < ck{n)/k{A). 
Since the function k is regularly varying of positive index. 



lim inf k(n)/k(A) 



and the result follows. 



Having made these observations on 'Ri^n,N, we can start a long 
string of approximations of T^^ ^. Referring to (3.4.1), we first re- 
place F^{l-Wi/WN+i) by F^{1 - l/n)(nWi/VFjv+i)-^/". Define 
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Our next lemma shows that we can replace T^^ ^ by T:^^ ^ in order 
to prove (3.4.2). Recall that ^ refers to the index of regular variation 
of {nifC) as a function of A, and that, except if specified otherwise, 
we allow it to vanish under (3.2.2) and (3.2.3). 

Lemma 3.4.6. // P is less than k, then 

A- ''rrP{3"^<^>^'"') ■ irf„,«-rt,«l>rf2g} = o. 

Proof. Let i be an integer in TZi,n,N- We have nWi/W^+i ^ niA. 
Lemma 3.4.2 implies that except on a set whose probability can be 
made arbitrary small by taking N large enough, i is at least N/ n^N ■ 

Hence, the strong law of large numbers yields that Wi is at least 
N/2n^]\f provided N is large enough. Then, nWj/Wjv+i is at least 
Consequently, (3.2.2) and (3.2.3) yield 

the Op{m~i^'') being uniform in i in 7^i,„,jv. Since {gn) is asymp- 
totically equivalent to a nondecreasing sequence and Lemma 3.4.3 
holds, we obtain 

Tt,n,N = Tl^,N + F^(l- ^)5nmX''H7^l,„,^Op(l) 

the Op-term being uniform in n between A and A^^'^. A variation 
on Lemma 3.4.5 implies the result. ■ 

In j^, we replace VFjv+i by A'", setting 
Lemma 3.4.7. If P is less than 1/2, 
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Proof. Taylor's formula, the central limit theorem and the strong 
law of large numbers yield 

wll^^ - ivi/° = iv(i/°)-(^/2)Op(i) 

as N tends to infinity. Lemma 3.4.2 and the strong law of large 
numbers imply that if i is in TZi^n.N, then W- ^ 2(^n^N /N^^^" 
whenever N is large enough. Therefore, using Lemma 3.4.3, 



uniformly in n between A and A^+^. The result follows by a simple 
adaptation of Lemma 3.4.5. ■ 

Seeking to replace TZi,n,N by the slightly simpler set 



we set 



Lemma 3.4.8. For any P less than (1/2) — e, 

^Ita l,msupP{3„e(A,A-) : IT^., - t;„.,| ^ T^g } = . 



Proof. If i belongs to the symmetric diflference Tli^n,N A 'R,2,n,N, 
then Gjv(Vj) ^ n/N, and either 

rwA ^ H^j ^ rwA — or ttt-a — ^ H'i ^ toa • 

n n n n 
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Thus, Wi lies in a region of width 

!I^\Wr,+^-N\ = ^^/NOp{l) 
n n 

with an cndpoint given by mj^N/n. In particular, i ~ m\N/n and 
(Vi, Wi) lies in a region of area of order at most 

^ViVOp(l) = mAA-(V2)+eo^(i) 
n 

the Op(l)-term being uniform in A ^ n ^ A-^"*"^. In particular, 
taking /? less than (1/2) — e, this area tends to at algebraic rate. 
Applying Lemma 3.4.4, there exists a positive A; such that 

lim P{ max '^{lZi^n,N A 7^2,„,Ar) ^ A; } = . 

Using again that all i in 7^i,n,Ar A TZ2,n,N are asymptotically equiv- 
alent to mp^N/n and using also the strong law of large numbers, we 
obtain 

1\ /iV\i/« 



N 



1-- - 5„ max /"tt(^i,n,iv A 7^2,„. 

The result then follows from Lemma 3.4.5. ■ 

Considering T+^_^, we seek to replace gn-NGN{Vi) by gin-NV,]- 
For simplicity, we will write Qn-NVi for the latter. Therefore, we 
define 



i£K.2,n,Af 



Lemma 3.4.9. For any f3 less than ((7 — 1) A l) /4, 
lim limsupP{3nG(A,Ai+^) : |T+, T+„ | > } = . 
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Proof. Let ei and 77 be two positive real numbers. Since the function 
(ld(l — Id))*^^^^^ is a Chibisov-O'Reilly function (see for instance 
Csorgo, Csorgo, Horvath and Mason, 1986, Theorem 4.2.3), 



max = Op{l) 

as N tends to infinity. If i belongs to TZ2,n,N, then Gat (14) ^ 
n/N and, using Shorack and Wellner's (1978, inequality (2)) linear 
bounds, Vi ^ cn/N with probability at least 1 — ei provided c is 
large enough. Thus, 



, / ri \ (i/2)-»7 

max N\GN{Vi)-Vi\^^/N(-) Op{l) (3.4.3) 



where the Op(l)-term is uniform in n between A and A^"*"^. 
For any integer r let 

rin(r) = max \gi+r - gi\ ■ 

l^i^n—r 

Inequality (3.4.3) implies that with probability at least 1 — ei 
provided c is large enough, 

max \gn-NGN{Vi) - 9n-NVi\ ^ max 0„(r) . (3.4.4) 

^e7^2.,^,Ar 0<-r<cn(i/2)-r,jV'7 

Recall that (2.2) holds. According to whether 7 is at least 2 or not, 
Lemmas 5.6 and 5.8 in Barbe and McCormick (2010) imply that 
whenever ^ is a positive real number less than (7 — 1) A 1, the right 
hand side of (3.4.4) is at most cgn{n~^^^^^~'^ N'^y . Since n is at least 
A in our range of interest, the right hand side of (3.4.4) is of order 
gn times A at the power —9/2 + 0(ry). Thus, if 77 is small and n and 
N are large enough, enough, 

'-p+ I 



^ F^(l --)(-)' ViV-^/' max W,-^/««7^2,„,ivOp(l) . 

Lemma 3.4.2 with TZ2,n,N substituted for TZi^n,N, the strong law of 
large numbers applied to the sums {Wi)i^i and Lemma 3.4.3 with 
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T^2,n,N substituted for 'Ri^n,N shows that the above upper bound is, 
in probabiUty, of order 

Thus, if /3 is less than ^/4, Lemma 3.4.5 imphes the result. ■ 

Next, using the regular variation of the sequence {gn), we would 
like to replace gn-NVi in n by ^71(1 — NVi/ny~^ . This leads us 
to define 

With regard to the next lemma, recall that 5 was introduced in 
(2.3). 

Lemma 3.4.10. If (5 is less than 5, then 

Proof. To approximate T^^ by T^^ j^, we need to rely on as- 
sumption (2.3). With respect to this assumption, we see that 'R.2,n,N 
contains 'good' points, for which 

. n-NVi , 
n 

guaranteeing that with (2.3) we can substitute gn{\ — NVi/n)''~^ for 
gn-NVi ) and 'bad' points, for which either 

n — NV- >: 

^ ^ or Vi > n/N . 

n 

We call Bi^n,N the set of all bad points for which ^ n—NVi ^ n^~^ 
and B2,n,N the set of those for which Vi > n/N. 

Let i be in Bi^n,N- Since it belongs to TZ2,n,N, Lemma 3.4.2 
shows that with probability arbitrarily close to 1 provided N is large 
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enough, i ^ N/nS,^- Therefore, since i is in 'JZ2,n,N, with probabihty 
arbitrarily close to 1 provided N is large enough, 

^Wi^ niA- 



2n^N n 
And since i is a bad point in Bi^ri,N, 

n — 'n}~^ n 

When thinking of Bi^n,N as a region as we did with TZi,n,N, we thus 
have with high probability, 

{n — n^~^ n N N ^ 

(V, W) : ^ ^ T7 ; TT-T- ^A— \ ■ 

The area of this upper bound is of order {n^~^ /N){m\N/n) = 
mx/n^ and tends to at an algebraic rate in A provided /3 is less 
than 6. Therefore, Lemma 3.4.4 implies 

max Pi,„,jv = Op{l) 

as A tends to infinity. 

Considering the bad points in T^^n^ have, since is 
equivalent to a nondecreasing sequence, 

^F^(l --)(-) g^.-s max W,-'/"tt^i,„,iv (3.4.5) 

This upper bound is of order F'*~(l — l/?7,)5f„n~'^'^^~^''^^/"(A^); since 
n is at least A and ^ is slowly varying, it is of order at most 
F'*~(l — l/n)gnn~^'^^~^^/'^. Lemma 3.4.5 then implies 

^li^^^p{3nMA,A-):F-(l-i)(f)"" 

E 9n-NV,W-"° >Tgi„_„f/k(A)}^0. (3.4.6) 

30 



Referring to Tg+^^^r, 

^ (l - i) (-) '^"ff„n-^(^-^) . max W,-^/«t)^i,„,^ 
V nJ \ n J ien2.n.N 



which is the same bound as in (3.4.5). Therefore, the analogue of 
(3.4.6) holds when substituting gn{l — NVi/n)'^'^ for gn-NVi- 

Dealing with the bad points in B2,n,N is easy because if > n/N 
then gn-NVi and (1 — NVi/n)^ vanish. So those points do not 
contribute to T+^^^ and T+^^^. 

On the part of T^^ ^ made by the good points, assumption (2.3) 
and Lemma 3.4.3 yield, on the range of n between A and A^+^, 



,n, ,71, N n) 

^ n~^gn . max Vl^~^^"tt^2,n,Ar 
^ A-'gn (^) '^"ruA log NOp{l) . 

The bound obtained for the error in the approximation in T^^ for 
the good points is then 



(l - ^)5nC^/"A-^mAlogiVOp(l) . 



If 13 is less than 6 then Cjv"^ '^mAlogiV tends to as A tends to 
infinity and Lemma 3.4.5 yields the conclusion. ■ 

We now replace Tl2,n,N in T^^n,N by 

r N n ) 

T^3,n,N = ■■ Wi^ '^^^ ' ^ iV / ' 

defining 
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Lemma 3.4.11. If 13 is less than (7 — l)/2, 

to^p{3„e(A,A-) : |r-„.„-ri.„|>T|2g}=o. 

Proof. If i belongs to 'R-2,n,N A 1Z3^n,N, then either 

Vi^J^^ GNiVi) or GNiVi) ^ ^ ^ ■ 

In the latter case, (1 — NVi/n)^ vanishes and so those points do not 
contribute to T^^ and T^^ j^. In the former case, arguing as in 
the proof of Lemma 3.4.9, 

y(l/2)-?7 

Vi^^^ GNiVi) ^Vi+ ' Qp(l) 



ri(l/2)-r7 
^Vi + ^;^N^Op{l), 

the last inequality coming from the first one and the Op (l)-term 
being uniform over i in 1Z2,n,N '^T^3,n,N and n between A and A^+^. 
In particular. 



n 



Consequently, using lemma 3.4.3 with Tl3^n,N substituted for Tl2,n,N^ 



X tl(7^2,n,iV A7^3,n,iv)Op(l) 

^ F^(l - ^gr,eil'"{n-^^'^^-^N^V-^mK\ogNOp{l) . 

Note that n'^^/'^^-'^ N"^ is at most A-(i/2)-r7+(i+2e)r,_ Provided 77 is 
small enough, 

(-^-r? + (l + 2e)r?)(7-l) + ^ 
is negative. We apply Lemma 3.4.5 to conclude. ■ 
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Having approximated all these T^^ j^, we need to consider their 
expected values, a much easier task. This requires us to have an 

estimate on how close 5[o,n) is to n-dn/l and how large fJ-^ is. We 
establish those estimates in the next two lemmas. 

Lemma 3.4.12. // (2.3) holds, then, as n tends to infinity, 

ngn 



Proof. We write 'yg[o,n)/i^9n as 

1 y ^ + 1 y El. (3.4.7) 

Since {g^) is asymptotically equivalent to a monotone sequence, the 
first term in (3.4.7) is at most 0{l)n~^ g^i-s / Qn = o{n~^). Using 
(2.3), the second term is at most 

7 -e-^ A/M'^""^ 



n ^ wn 



1 [£ ^ jx^-' dx + 0(1)) + oin-') 



= 1 + 0(n-T"5) + o{n-^) . 
The result follows since 7 exceeds 1. 

The proof of Lemma 3.2.2 shows that if /3 is small enough, 



lim sup sup 



kinhn,A-^rn\-'/'^\<oo. (3.4.8) 



Lemma 3.4.13. If l3 < 5a/ {a — 1), there exists a positive T such 
that for any A large enough and any n in (A, A^"*"^), 

|Er+„,^-Er+„,^KT|^. 
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Proof. Lemmas 3.4.12 and (3.4.8) yield 

^Ti,n,N - = n5n<Ao(n-^) (3.4.9) 

= 5ni^-(l-l)mi-^/"n-Vl). 

The sequence m\ A~'^ is regularly varying of index j3{l — l/a) — S, 
which is negative provided /3 is small enough. Thus, Lemma 3.4.5 
shows that we can replace ETj^^ by ngnjJ''^ ^/^ to prove the current 
lemma. 

The calculation of ET^^ ^ can be done by using that Wi has a 
gamma distribution with parameter but an easier argument will 
show after our next lemma that 

ET^^,, = F-(l-i)^-^mr/«. (3.4.10) 
Thus, it suffices to show that for any T large enough. 

This follows from (3.4.8) and Lemma 3.4.5. ■ 

Combining Lemmas 3.4.6-3.4.11 and 3.4.13, we see that in order 
to prove Proposition 3.4.1, it suffices to show that 

limsupP{3ne(A,A^+^) : |r+„^^ - Er+„^^| ^ r^[o,„) A(A) } = . 

A— )-cx> 

(3.4.11) 

Our next lemma will allow us to represent ^ as an integral 
of a Poisson process over the quadrant [0, oo)^ and prove a valuable 
scaling property. 

Lemma 3.4.14. We can construct a Poisson process VL on 
[0, oo)^ with mean intensity the Lebesgue measure, such that the 
point process obtained by restricting IT to [0,1] x [0, oo) coincides 

Proof. Let N' be a homogenous and unit intensity Poisson random 
measure on (l,oo) x [0,(X)), independent of the sequence {Vi,Wi). 
Define as AT' + J^i^i S(Vi,Wi)- ■ 
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We then rewrite T^^ ^ as 



In this expression, considering only the sum over i and thinking of 
n/N as a continuous variable t, we are led to introduce the process 



TaW = Y.^t - V,)l-^Wr^'''l{tWi ^ ruA } 



indexed by t in [0, 1 ]. Given Lemma 3.4.14, we can extend Ta to a 
process over the nonnegative half-Hne 

Ta(0 = J {t-v)l~^w-^/'^l{tw ^ mA}dn{v,w). 

We then have 

In particular, ET.^^ is indeed given by (3.4.10) since the intensity 
of n being the Lebesgue measure, 

ETA(t) = y"(* - v)l~^w-^/''l{ tw^niA} dv dw 



-f-j—l+l/a 



-m 



(a-l)/a 



a 



■■''A 1 ■ 

7 a — 1 

Given (3.4.12), in order to prove (3.4.11) it suffices to show that 

-iV\ (l/«)+7-l 



^lim limsupPjan G (A,A^+') : F^(^l-^^g„ 

|TA(n/Ar) - ETA{n/N)\ > Tg^o,n)/k{^) } = . (3.4.13) 

The scaling property we alluded to is the following. 

Lemma 3.4.15. For any positive real number X, the processes 
Ta(A-) and A'''~^"'"(^/")Ta have the same distribution. 
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Proof. We rewrite Tj<^{\t) as 



J{Xt - v)l~^w-^^'^ 1{ Xtw ^ ruA } dU{v, w) 



^y-i+i/a J (^t-jY^ \xw)-^/"l{tXw ^mA}(m{v,w). 

The image of the Poisson random measure H by the map {v,w) 
{v/X,Xw) is a Poisson random measure of intensity the Lebesgue 
measure, proving the lemma. ■ 

In what follows we will use the following terminology. We say that 
a sequence of either functions or random variables, (/„), converges 
to / in L^(^)-norm if Iim„^oo / (/n — /)^ d/i converges to as n tends 
to infinity. In our setting, (/„) and / may not be in L^(//) but fn~ f 
is. If fi is the underlying probability P, we will write for L^(P); in 
that case, convergence of the sequence of random variables (fn) to / 
in L^-norm means that lim„_).oo E(/n — /)^ = 0, again, even though 
/„ and / may not have finite variance but fn — f does. 

Similarly, we will write that f = g in L^-norm, to mean E(/ — 
g)"^ = 0, even though / and g may not be square integrable. 

Writing n/N as (A/A^)(n/A), Lemma 3.4.15 shows that, as a 
process indexed now by n in (A, A^+^), 

/ A\7-l+(l/a), 



^HivJ^livJ ^4a 



Therefore, to prove (3.4.13) it suffices to show that 



lim limsupP/anG (A,A^+') : F^(l 



/A\ (i/«)+7-i 
Ta^) - EtQ I > T3[o,n) A(A) } = , 



or, equivalently, that 

lim lim sup P I 3n G (A, A^+'' 



> T 



n\ (i/«)+7-i k{n) 
a) k(Aj 



0. 



Let r/ be a positive real number less than {a — l)/2a and 1 — [a/2). 
Using Potter's bound, k{n)/k{A) > (ra/A)^~(^/")~'' uniformly in n 
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between A and A-'^+^ and as A tends to infinity. Thus to prove (3.4.13) 
it suffices to show that 



lim limsupPj 3n G (A, A^+'') : 



Setting 



IaA^^w) = {t-v)l-'w-^/°'l{w^ niA/t}, 



we rewrite the centered version of Ta as a compensated Poisson 
integral, 

(TA-ETA)(t) = J /A,t(t;,ii;)d(n-En)(i;,^f;). 

As A tends to infinity, the function /A,t converges pointwise to 

Mv,w) = {t-v)l-^w-'/'^. 
This convergence holds in ( dv dw;)-norm since 

J {fK,t- hf{v,w) dvdw 

= J{t-vf_^'^~^^w-^/''l{w^mA/t}dvdw 

_ ^2(7-l+l/a)_-(2/a)+l ^ CS 4 151 

(2-a)(27-l)- ^ ' 

Recall that the compensated Poisson integral induces an isometry in 
the sense that for any function / in L^{dvdw) 

e(^J fd{U-EU)y = J f{v,w)dvdw. 

It then follows from (3.4.15) that limA^oo Ta — ETa exists pointwise 
in L^-norm and is the compensated Poisson integral 



To(t) = J /id(n-En). 



Our next lemma implies that we can replace Ta — ETa by its limit 
To in 3.4.1. 
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Lemma 3.4.16. Provided P is positive, we have 
lim limsupPj 3n G (A, A^+^) : / (/a,„/a - L/k) d(n - EH)! 

T->-oo A^oo J I 



Proof. Since 

{ft - fA,t){v,w) = {t-v)l-'w-^/"l{w^ niA/t} 
is in LP( dvdw) for any p greater than a, let 

= E (| (/A,t - /* ) d(n - En)) ^ 

In what follows we restrict p to be an integer. Using Privault's (2009, 
equation 9; or 2010, equation 2.9) moment identity (see also Bassan 
and Bona, 1990), we have for p at least 2, 

^P= E (^l^) fifA,t-ftr-Hv,w)dvdwMk. (3.4.16) 

We now prove by induction that for some constant Cp, 

\Mp\ ^ CpiP(T-i+V«)mX^^/"^+L^/'J . (3.4.17) 
Indeed, Mi vanishes and, as shown in (3.4.15), 

Assume that for any k less than p, 
Since 

I (ft - h,tY-\v, w) dv dw = ct(^-'=)(7-i+va)^;^-((^'-'=)/«) , 

equality (3.4.16) and the induction hypothesis imply 

^ ^k('r-l+l/a)^-{k/a) + [k/2i ^ 
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In this sum, bounding m^^'^^"^^^^^'^^ by mf}^^°^^^^^^ yields 

which is (3.4.17). 

We then take p to be an even integer. Applying Markov's 
inequahty for any n between A and A^+^ and using (3.4.17), 



P{ 1/ (/A,n/A - /n/A) d(n - EH) | ^ ^(x)^ ' } 

^T-P -) cj-) m 
\n 



A 



n 



Applying Bonferroni's inequality, the probabihty involved in the 
lemma is at most 



n 

A<n^Ai+'= 



-p(l-(l/a)-»7) 



Taking p larger than l/(l — (l/a) — ry) , this bound is of order 

(.rY-V^v{\-{\loc))^-v{.\-(^lc^)-(.^i'l)) ^\-v{\-{llc.)) 

This bound is regularly varying in A of index 

1 1^ 



Thus, taking p larger than 2a/ (/5(2 — a)), it tends to as A tends 
to infinity, proving the lemma. ■ 

Given Lemma 3.4.16, we see that to prove (3.4.14) it suflaces to 
show that 

lim limsupPj 3nG (A,A^+^) : |To(n/A)| yTin/Ay-"} =0. 

(3.4.18) 

Our next step is to identify the process Tq as a fractional integral 
of a spectrally positive Levy stable process. 
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Consider the spectrally positive centered Levy stable process 
given by its Ito representation 

This process is the pointwise limit in L^-norm of 

Lleit) = J l[0,t]{v)w-'/^llo,l/e]iyj)d{U-EU)iv,w) 

as e tends to 0. Moreover, defining 

-t^EW,-^/'^l[o,i/e](W^O) 
= j 7(^-^')^'^"'^°l[o,l/elHd(^-E^)(^;,w;), 

we see that Lq'^^ converges pointwise in L^-norm to 7T0 as e 
tends to 0. It follows that pointwise in L^-norm, 

^t{t) = j{t-v)l-UL+{v). (3.4.19) 

Lemma 3.1.7 in Barbe and McCormick (2010) implies that the right 
hand side of (3.4.19) is almost surely continuous. Considering the 
fractional integral 

Lt^'-'\t) = Jj{t-v)l-UL+iv), 

and since T+(n/A) and Lp'^~^\n/A)/j coincide in L^ -norm for any 
integer n between A and A^"'"'^, we see that in order to prove (3.4.18) 
and therefore Proposition 3.4.1, it suffices to show the following. 

Lemma 3.4.17. For any positive r] sufficiently small, 

lim P{3t^l : |L+(^"^^(i)| ^ T^-n = 0. 
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Proof. Note that L'^ vanishes at 0. For any nonnegative t, the 

function (t — Id)^~"^ is deterministic, different iable on [0,t], so 
that its quadratic covariation with Lq vanishes on [0,t]. We then 
integrate by parts the integral defining Lq''"''^'' (see Protter, 1992, 
chapter 2.6, Corollary 2) as 

Li^'~'\t) = 7(7 - 1) / L+m - v)l-' dv. 

It follows from Pruitt (1981) that there exists a constant c and a 
random t^o such that |Lq (t;)| ^ ct;*^^/"^"'"'' for any v at least vo- This 
implies that for t at least vo, 

f \mv)\{t - V)l-^ dv ^ ct^-l+(Va)+'7 . 
J vo 

Since 

[■■"0 

/ \L+{v)\{t-v)l-^dv^c sup \L+{v)\r-^ 

Jo O^D^IJO 

and — 1 + (l/a) + 2ry is negative for rj small enough, we have 

lim i-^+''L+(^"^^(t) = 

almost surely. The lemma follows. ■ 

3.5. Concluding the proof. Having completed the proof of 
Proposition 3.4.1, we can complete that of Theorem 2.2. 
First, we settle the assertion that 

supLQ'''~^^(i) — t'^ is almost surely finite. (3.5.1) 

Let Lq^'^~^'' be an independent copy of Lq^'^~^\ It is shown in 
section 3.3 of Barbe and McCormick (2010) that Lq'~^'' has the same 
distribution as pi/«L+^^"^^ - q^/'^L'^^^~'^\ Consequently, (3.5.1) 
follows from Lemma 3.4.17. 

To complete the proof of Theorem 2.2, we set 
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Note that 

?r = - gi{-^n-i)H^n-i ^ -CLuA} ■ 

If assumption (2.6) hold, we substitute M^iF for F in steps two, 
three and four to obtain that 

hm UmsupP{3n^A : jT" - ET"] > r5f[o,n)/fe(A) } = . 

This, combined with Propositions 3.1.1, 3.2.1, 3.3.1 and 3.4.1 give 
our heavy traffic approximation under (2.6). 

In order to prove Theorem 2.2 under (2.7) we will use a coupling 
argument based on a decomposition of the innovations into a part 
which is bounded from above and a part which is bounded from be- 
low. The underlying idea is that the part bounded from above should 
not contribute too much to the process Sn reaching the boundary 
(^9[o,n)- To make this argument viable, note that combining Propo- 
sitions 3.1.1, 3.2.1, 3.3.1 and 3.4.1, Theorem 2.2 holds when F is 
supported on some interval bounded away from — oo. 

The following lemma allows us to define the proper representation 
of the innovations. If G is a distribution function, G'*~(0-|-) and 
G^{1) are respectively the lower and upper end point of the support 
of the underlying probability measure. 

Lemma 3.5.1. Let F be a distribution function on the real line, 
centered and such that F is regularly varying. There exists two 
distribution functions Fl and Fu and ar in (0, 1) such that 

(i) F^(0+) > -oo and F^{1) < oo, 

(a) Fu and Fl are centered, 

(Hi) F = vFu + {1 - r)FL. 

Given assertions (i) and (iii), we must have F = rFjj and M-iF = 
(1 — r)M-iFL ultimately. Thus rFu and (1 — r)FL capture respec- 
tively the upper and lower tails of F. 

Proof. Since F has a mean, define A(t) = J^^ ^^xdF{x) and set 
9 = A{0)/2. The function A is nonincreasing and cadlag on the 
nonnegative half-line. Let 

ti = inf { t : A{t) <e}. 
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If A{ti) < 9, then F has a jump at ti and there exists a positive ri 
at most F{ti) — F{ti—) such that A{ti) + Titi = 6; otherwise we set 
n = 0. 

Similarly, define B{t) = J,^ .xdF{x). The fimction B i 



IS 



nondecreasing on the negative half-line. Since F is centered, 
]imt^_^B{t) = -A{0). Let 

t2 = sup{t : B{t) <-e}. 

If B{t2) > —0 then F has a jump at t2 and we define T2 such that 
B{t2—) + T2t2 = —0; otherwise, we set T2 = 0. 
We define the measure nu by 

= l(t2,0] + l(ti,oo) +T2l{t2} , 

and set Fu = iijj / nuiM). By construction Fu is centered. Set 
r = M[/(M) and define Fl = {F - rFu)/{l - r). ■ 

Our next lemma, valid since a is positive and less than 2, relates 
the moment generating function of F^ to the bound (2.7). It is 
convenient to define 

D{t) = ^^F{nogt)logt, 

r being as in Lemma 3.5.1 and the constant c being, for once, the 
same as in (2.7) 

Lemma 3.5.2. The following holds as A tends to from above, 
I e'^ dFUx) ^ 1 + (i) du{l + o(l)) . 



Proof. Since Fl is centered, two integrations by parts yield 
xdFL{x) = - 1 FL{x)dx+ FL{x)dx. 

J -oo Jo 

This identity, an integration by parts and considering that Fl 
vanishes ultimately yield that the moment generating function of 
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Fl is 

/O /■oo 
(1 - e^^)FL(x) dx + X (e^=^ - l)Fi(x) dx . 
-oo Jo 

Let be a negative real number such that (1 — r)FL coincides with 
F on (—00, to] and and M^iF ^ (1 — r)D on [to, 00). Since Fl 
vanishes ultimately, 

/•O poo 

A / (1 - e^^)FL(x) dx + A / (e^^ - dx = O(A^) 

as A tends to 0. Hence, 

/ e^^ dFL{x) ^ 1 + A / ° (1 - e^^)L>(-x) dx + ©(A^) 

J J —CO 

= 1 + /^*" (1 - ey)Di-y/X) dy + OiX^) . (3.5.2) 
J —00 

Since D is regularly varying of index —a less than —1, the integral 
in (3.5.2) is asymptotically equivalent to 

1\ 



Since a is between 1 and 2, D{l/X) S> A^ as A tends to and the 
lemma follows. ■ 

To conclude the proof of Theorem 2.2, write F = rFu + (1 — r)Fi 
for the decomposition given in Lemma 3.5.1. Let (Xu^i) and (^L,i) 
be two independent sequences of independent random variables 
distributed respectively according to Fu and Fl. Let (Bi) be an 
independent sequence of independent random variables having a 
Bernoulli distribution with parameter p. Set 

Xi = BiXu^i + (1 — Bi)XL,i ■ 
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By construction (Xj) is a sequence of independent random variables 
all having distribution F. Let (S'n), {Su,n) and {SL,n) by the {g, F)-, 

{g,Fu)- and (5, FL)-processes based on (Xi), {Xij,i) and (^L.i) 
respectively. We have Sn = SL,n + 'S'^/^n- Hence, refering to (3.6), 

P{3n^A : S„ > 2rp[o,„)/A;(A) } 

^ P{ 3n ^ A : > r5[o,„)/A;(A) } 

+ P{ 3n ^ A : > Tg^o,n)/K^) } 

Using the part of Theorem 2.2 that we proved already, more precisely 
when the innovations are bounded from below, 

lim lim sup P{ 3n ^ A : Su n > Tg\Q /fc(A) } = . 

Hence, using a Bonferroni inequality, it suffices to show that 

lim limsup V P{SL,n > T(7[o,n)/fe(A)} = 0. (3.5.3) 

For this, let (p be the moment generating function of (1 — Bi)XL^i 
and let (pL be that of Xl^i. We have 

ip{t) = Ee*(^--^*)^^'* = r + (1 - r)v3L(i) • (3.5.4) 

The exponential form of Markov's inequality yields for any positive 
A 

P{ SL,n > Tg[o,n)/HA) } ^ exp(-Ar|^ + log^{Xgi)) • 

(3.5.5) 

In this inequality we take A = A;(n)(logn)/gi[o,n) and proceed to 
estimate (3.5.5). 

Since k is regularly varying of positive index, k{A) ^ ck{n) if 
n ^ A and A is large enough. Consequently, XTg^Q n^/k{A) > cT. 
Since (3.1) holds, our choice of A implies 

logn 
V^(l-l/n)5„' 

thus, since {gi) is asymptotically equivalent to a nondecreasing 
sequence, the bound 

log n 

max Ag,- ^ c— — ; -— 

o^i<n ^' F^{l-l/n) 
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shows that this maximum tends to as A tends to infinity and n is 
at least A. Then, considering (3.5.4) and Lemma 3.5.2 to bound i^l, 
we obtain that for A large enough, n at least A and any i between 
and n, 

\og^{\gi) ^ Iog(r + (1 - r)(l + cD{l/\gi))) 

= \og{l + cD {I /\gi)) 
^ cD{l/\gi) . 

Since D is regularly varying of index —a, this implies that (3.5.5) is 
at most 

/ /F'^il — lln)\\ 
exp i^-Tc log n + cnD ipg^ )) ■ (^•^•^) 

We claim that 

^/ F-(l-l/n) N ^logn_ 
V logn / n 

Indeed, setting s = — l/n)/logn, we have slogs ~ cF*^{l — 

1/n), which implies F(slogs) ~ c/n. Moreover logs ~ clogn 
as n tends to infinity. This allows us to write (3.5.7) as D{s) ^ 
clog sF(s log s) which is true by definition of D. 

Combining (3.5.6) and (3.5.7), we see that, if T is large enough, 
(3.5.5) is at most This proves (3.5.3) and completes our proof 
of Theorem 2.2. 



3.6. On assumption (2.5). To explain the role of assumption 
(2.5), we first explain that of (m„). The proof of Propositions 3.1.1, 
3.3.1 and Lemma 3.4.16 are similar: we evaluate some moment 
of high order and use Bonferroni's inequality. In order for the 
Bonferroni bound to tend to 0, we need (m„) grow to infinity at 
least at an algebraic rate. 

In step 2 we do not rely on (2.5) but on (3.2.2). If (m„) were 
allowed to be slowly varying, step 2 would sill hold. The same is true 
for the approximations of the T."^^^ ^- in step 4, with the caveat that 
for Lemma 3.4.3 to hold, we need to have liminf„_^oo n^n/ logn > 0, 
but this is essentially implied by (3.2.3). 

That (m„) has to grow at an algebraic rate makes (3.2.2) equiv- 
alent to (2.5). So we see that the only reason (2.5) is needed is 
because our crude estimate in the proofs of Propositions 3.1.1, 3.3.1 
and Lemma 3.4.16. 
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If we do not take those propositions and this lemma into account, 
the condition (3.2.3) would allow m„ = (log n)^"*"^. To obtain an even 

slower rate requires not to rely on Kiefer's theorem. It is conceivable 
that a good description of the extremes {Uil{ Ui > l — nin/n })i^i^n 
as n changes could yield a better result with no other condition than 
(2.5). This seems related to the asymptotic behavior of m„-records, 
but our attempt to devise a proof in this direction failed. 

Note that assumption (2.3) was used only in the proof of Lemma 
3.4.10 and 3.4.13. A close examination of the proofs shows that we 
could replace (2.3) by the existence of a sequence (p„) such that 



lim sup sup 



9i_ _ /j_\T-i 



< oo 



and Pn ^ ^r/°^{'mn V logn). So, any improvement on the rate of 
growth of (m„) would translate into an improvement of (2.3) as 
well. 

4. Proof of Proposition 2.1. (i)^(ii). Write F^{1 - 1/t) = 
t^/°'i{t) where i is regularly varying. Note that i is ultimately 
positive. If (i) holds then, using 1/A instead of A, 



lim r sup A^/" 



m 



0. 



In particular, for any fixed A greater than 1, we have, for any t large 
enough, 

e{t){i - 1-'') ^ i{xt) ^ £{t){i + 1-'^) . 

Hence, for any positive integer n, 

e{r-H){i - (r-H)-") ^ i{X't) ^ £(A"-4)(i + (A"-4)-'') . 

By induction, this implies 
Since £ is slowly varying. 



lim sup — r- — - = 1 . 

"-^°°se[A"t,A"+it] «(A"ij 
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Therefore, 
^(i) - (A*^)-'') ^ liminf £(s) 

limsup£(s) ^ ^(t) ]J(1 + {XH)-") . (4.1) 



s— >-oo 



Since 

lim TT(l - {XHy) = lim TT(l + iX't)-") = 1 , 



we obtain 

lim sup ^(t) ^ liminf ^(s) ^ lim sup ^(s) ^ liminf ^(t) , 

t-i-oo s-J-oo s-)-oo t^oo 

proving that limt_^oo £{t) exists. This limit is then positive due to 
(4.1). Therefore, there exists a function d{-) which tends to at 
infinity such that 



F^(l-l/t) = cti/°(l + (5(i)). 
We can then rewrite (i) as 



lim r sup A^/" -1=0. (4.2) 



1 + 5{t) 



Since S{-) tends to at infinity, (4.2) implies 

lim r sup A^/" \5{Xt) - d{t)\ = . 

t-s-oo t-^^A^f* 

In particular, if e is a fixed positive real number, for any t large 
enough, considering X = t'^, 

\S{t^+'') - 6{t)\ ^ et— (i+V") . 
Substituting for t, we obtain 

Since S{-) tends to at infinity, summing all these inequalities over 
n nonnegative, we obtain 

\6{t)\ ^ et-(i+V") + . 
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Consequently, 6{t) = o(t-'*(i+i/°)) and (ii) holds. 
(ii)^(i). Whenever t A (Ai) tends to infinity, 

F^(l-l/t) V i + o(t-''(i+Va)) 

= A^/" (o((At)-'^(i+i/")) V o(t-'^(i+i/"))) . 

In particular, since k is less than both 1 and 2/(a + 1), 



sup 



F-(1-1/At) ^1/, 



and (i) holds. 



(ii)^(iii). Consider the relation x = — l/t). Given (ii), this 

means, as either t or x tend to infinity, 

X = ct^l'' (1 + o(t-"(^+^/"))) . (4.3) 

The proof is then an easy exercise in asymptotic analysis. In 
particular, x ~ ci^/" and t ~ {xjc)^. Write t = (x/c)°(l + y) 
where y tends to as t tends to infinity. Using (4.3) we obtain 

x = x{l + 2/)^/" (1 + o(x-'^("+^))) 

= x+ -xy + o(a;^-'^("+^)) + 0(xy^) . 
a 

Therefore, y = o(a;-'*(°+i)) + 0{y'^). This forces y = o(a;-'"(°+i)). 
Thus, 

t = (x/c)" (1 + o(x-'^(«+^) )) . (4.4) 

Since x = F'*~(l — l/t) and F is continuous, we have F{x) = l/t as 
t tends to infinity. Given (4.4), this implies 

F{x) = (c/x)"(l + o(x-'^(«+^))) , 

that is (iii). 

(m)^(ii). The proof is similar to that of its converse. 
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